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EMBEDDED DATA LAYERS 

FIELD OF THE INVENTION 
[0001] The present invention relates generally to data layer embedding in images. 

BACKGROUND 

[0002] Images or text (referred to herein as images) are typically formed in modern systems 
by generating and displaying the component pixels of the image. With modern printing 
devices, such as, but not limited to, industrial printers, plotters, facsimile machines, laser 
printers, or ink jet printers (referred to herein collectively as printers), this image is typically 
formed on a print medium by the placement of pixels on the print medium with one or more 
printing toners, inks, or transfer/donor materials from a print ribbon (for example, plastic tape 
based label maker). Alternatively the pixels of the image can be brought out of the print 
medium itself by exposing it to a chemical, heat, or light based process in the varying 
strengths and patterns of the pixels of desired image (for example, thermal printers, 
photographic films, lithography, and etching). 

[0003] Multiple methods of coding information into the pixels of images in manners that 
minimally change the underlying image and how it is perceived by human viewing exist and 
are generally referred to as steganography and/or watermarking (referred to herein as 
watermarking). Watermarking of images has been generally used for cryptography, 
security/authenticity of an image, rights management, tamper-proofing an image, and for 
proof of origin of an image. 

[0004] The coding rate of a watermark, the relative amount of secret information that can be 
reliably embedded in the image, typically involves a tradeoff with visual quality and 
robustness. A higher coding rate allows more information to be embedded in the image, but 
tends to reduce the visual quality of the image and robustness in decoding the message. 
Conversely, a lower coding rate tends to provide less information, but the image has a higher 
visual quality and the decoding is more robust. Because of the image quality and robustness 
issues watermarking has typically been utilized to encode a small amount of data into an 
image with a lower coding rate. Watermarking also typically encoded the image as a whole 
to improve image quality, robustness, and data content by utilizing as large an image area as 
possible. As stated above, it is desirable, however, to perform hardcopy watermarking that is 
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robust, has a high coding rate, and yet has a high visual quality to the resulting image. 
Several new methods of watermarking have been allowing for these qualities. One such 
method of watermark encoding that has a high coding rate, while being generally robust and 
having a high visual quality, and yet can be used in multiple transform domains, is described 
in United States Patent Application Pub. No. US 2002/0176599, published November 28, 
2002, titled "Hardcopy Watermarking", by Levy et al., which is commonly assigned. 

[0005] In many situations there is information or data that is associated with an image or the 
content or one or more elements in an image. For example, the date and location of an 
image, the person, place, or subject matter of an image. In advertising or in other commercial 
images this associated information may include the commercial details or various 
specifications of the pictured subject; for example, contact information, size, availability, 
and/or prices. 

[0006] A problem with this image information or image "metadata" is that it is typically not 
permanently associated with the image and can be lost or, in the case of advertising or 
commercial images, not readily available for reference or presentation when the image is 
used or shown. This is particularly a problem with advertising or commercial images in that 
in many cases the image or resulting print medium is composed of multiple sub-images that 
can come from different sources and/or vendors. Additionally, text space or alternative 
print/presentation space on the print medium is typically at a premium and not all of the 
associated information may be able to be printed, or if it is printed is not directly associated 
with the image or sub-image it refers to and therefore may be misinterpreted by the reader. 
Furthermore, as stated above, it is often desired to associate multiple different types of 
common information in differing information fields (such as date, title, location, subject 
matter, etc.) with a given image or with each image of a set of images. This is particularly 
the case in advertising or commercial images where documents or advertising flyers are 
composed for specific purposes by retrieving the images from databases or repositories of 
images. The advertising or commercial associated information content may also vary 
depending on promotions, sales, region, presenter, vendor and/or advertiser, etc.. 

[0007] For the reasons stated above, and for other reasons stated below that will become 
apparent to those skilled in the art upon reading and understanding the present specification, 
there is a need in the art for an improved method for embedding associated information with 
images, and in particular commercial or advertising images. 
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SUMMARY 

[0008] The various embodiments described herein facilitate steganographic embedding or 
watermarking of multiple data fields or data layers (image metadata) in an image or in one or 
more of the sub-images/objects (component images) contained in the image. The various 
embodiments include images with two or more data fields embedded into them in two or 
more watermarks of differing encoding or defined within the same watermark at a high 
coding rate. In addition, other embodiments include two or more data fields defined within 
one or more sub-images/objects of the image. Methods and apparatus are also included for 
encoding and decoding the multiple data fields. In one embodiment of the present invention, 
an image includes multiple layers of metadata, each layer storing a data field of associated 
image data. In another embodiment of the present invention, one or more sub-images of an 
image include multiple layers of metadata, each layer storing a data field of associated image 
data. Embodiments of the present invention allow for the advantages of storing multiple 
layers of associated data embedded with an image or with each sub-image which would not 
otherwise be available allowing it to be retrieved by an end-user with a watermark enabled 
scanner or image reader (herein referred to as a reader). Additionally, embodiments of the 
present invention associate the multiple layers of data directly with an image or sub-image 
allowing the data to be specific to the image/sub-image and contextual, reducing the potential 
for reader misunderstanding and improving communication. Embodiments of the invention 
include apparatus and methods of varying scope. 

DESCRIPTION OF THE DRAWINGS 
[0009] Figure 1 is a simplified diagram of an image and data layers in accordance with an 
embodiment of the present invention. 

[0010] Figure 2 is a simplified diagram of an image with multiple sub-images/objects and 
data layers in accordance with another embodiment of the present invention. 

DETAILED DESCRIPTION 
[0011] In the following detailed description of the present embodiments, reference is made to 
the accompanying drawings that form a part hereof, and in which is shown by way of 
illustration specific embodiments in which the invention may be practiced. These 
embodiments are described in sufficient detail to enable those skilled in the art to practice the 
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invention, and it is to be understood that other embodiments may be utilized and that process, 
electrical or mechanical changes may be made without departing from the scope of the 
present invention. The following detailed description is, therefore, not to be taken in a 
limiting sense, and the scope of the present invention is defined only by the appended claims 
and equivalents thereof. 

[0012] Embodiments of the present invention utilize multiple transform or high coding rate 
watermarking to embed multiple metadata data fields in an image or in one or more of the 
objects (the component images) of the image. In one embodiment, images have two or more 
data fields embedded into them with each data field embedded in watermarks of differing 
encoding. In another embodiment images have two or more data fields embedded into them 
with each data field or defined within the same watermark, where the watermark has a high 
coding rate. In addition, other embodiments include two or more data fields defined within 
one or more sub-images/objects of the image and each embedded in two or more watermarks 
of differing encoding or within one watermark at a high coding rate. Methods and apparatus 
are also included for encoding and decoding the multiple data fields. In one embodiment of 
the present invention, an image includes multiple layers of metadata, each layer storing a data 
field of associated image data. In another embodiment of the present invention, one or more 
sub-images of an image include multiple layers of metadata, each layer storing a data field of 
associated image data. Embodiments of the present invention allow for the advantages of 
storing multiple layers of associated data embedded with an image or with each sub-image 
which would not otherwise be available allowing it to be retrieved by an end-user with a 
watermark enabled scanner or image reader. Additionally, embodiments of the present 
invention associate the multiple layers of data directly with an image or sub-image allowing 
the data to be specific to the image/sub-image and contextual, reducing the potential for 
reader misunderstanding and improving communication. Embodiments of the invention 
include apparatus and methods of varying scope. 

[0013] As stated above, steganography and watermarking are methods of encoding 
information into the pixels of images in manners that are robust and have a high resulting 
image quality. Prior art watermarking typically encodes only a small amount of data in a 
single layer of watermark encoding at a low coding rate in an image to preserve image quality 
and robustness of the encoded data. This watermark is also generally encoded in the image 
as a whole. In addition, the use of watermarking in images and, in particular, printed material 
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has suffered from issues of reliability in that they may be easily damaged and rendered 
unreadable. Newer systems of watermarking allow for high coding levels and increased 
robustness, while maintaining a high level of image quality. This allows for the encoding of 
multiple layers of data/data fields into a given image or into objects within a given image 
utilizing multiple watermarking methods that utilize differing transforms and/or encoding 
methods or within a single watermark when the watermark allows for a high coding level. 
This watermarking of multiple data levels, enabling storage of two or more data levels in a 
given image or sub-image/object in a printed page, allows for image information/associated 
information/"metadata" to be embedded and permanently associated with the image. 
Watermarking of sub-images/objects allows multiple levels of metadata to be provided for 
multiple arbitrary objects in a page and not just the entire page, allowing the information to 
be relevant to the scanned object and readily available for reference. 

[0014] In the case of advertising or commercial images, embedding of multiple data levels in 
the image or objects of the image allows the related product information to be readily 
available for reference or presentation through use of a watermark enabled reader or viewer 
when the image is used or shown. This is particularly advantageous for advertising or 
commercial images for in many cases the image or resulting print medium is composed of 
multiple sub-images that can come from different sources and/or vendors, where advertising 
flyers are composed for specific purposes by the advertisers from stock images supplied by 
the vendor/manufacturer. The advertising or commercial associated information content may 
also vary depending on promotions, sales, region, presenter, vendor and/or advertiser. 
Additionally, text space or alternative print/presentation space on the print medium is 
typically limited and/or costly to the advertiser and/or specific vendor and not all of the 
associated information may be able to be printed, or if it is printed it is not directly associated 
with the image or sub-image it refers to and may therefore be misinterpreted by the reader. 
Furthermore, as stated above, it is often desired to associate multiple different types of 
common information in differing information fields (such as date, title, location, subject 
matter, etc.) with a given image or with each image of a set of images. 

[0015] Figure 1 is a simplified diagram of an image 100 of an embodiment of the present 
invention. In Figure 1, the image 100 contains one or more graphical sub-elements or objects 
104 (referred to herein as objects). Embedded into the image 100 is a watermark (not shown) 
that contains two or more layers of metadata 102 encoded into a composite watermark made 



up of multiple sub-watermarks of differing transforms/encodings or within a single 
watermark of a high coding rate, where the number of multiple watermarks or coding rate of 
the single watermark are configured to be large enough to encode the number and amount of 
data in the defined metadata layers. Each layer of metadata 102 can contain one or more data 
values or data areas. The metadata 102 stored in the watermark is accessible by a user 
through use of a watermark enabled reader. 

[0016] Figure 2 is a simplified diagram of an image 200 of an embodiment of the present 
invention having one or more sub-images/objects that contain watermarks. In Figure 2, the 
image 200 contains one or more graphical image objects 206, 208, and 210. Selected image 
objects 206, 208 each contain an embedded watermark (not shown) that each contains two or 
more layers of metadata 202, 204 encoded into a composite watermark made up of multiple 
sub-watermarks of differing transforms/encodings or within a single watermark of a high 
coding rate. The image objects 206, 208 that contain embedded watermarks can be arbitrarily 
selected and/or defined in the image 200. Each layer of metadata 202, 204 can contain one or 
more data values or data areas. The metadata of each watermarked object 206, 208 in the 
image 200 is accessible by a user by scanning the object with a watermark enabled reader to 
read the data layers embedded in their watermark. It is noted that the image 200 of Figure 2 
has multiple levels of metadata provided for multiple arbitrary objects in its page and not 
only just for the entire page. 

[0017] Users may select the metadata layers of the images 100, 200 illustrated in Figures 1 
and 2 to view after accessing them with a watermark enabled reader. Alternatively, readers 
or reader software may be configured to show or not show a given layer to the user, or only 
those layers accessed by them with the appropriate code/personal identification number 
(PIN). Additionally, in some embodiments, the information contained in the metadata layers 
may be used by the reader software to activate further processes, including, but not limited to, 
accessing the internet, accessing a database, accessing a program, enabling execution of an 
application or access to a computer system, and decoding encrypted content. 

[0018] In other embodiments of the present invention, the multiple layers of metadata in a 
given object or image contain standardized data types in each different level. For one 
embodiment the data layers for an advertising oriented image or object are defined as 
follows: Layer One - Manufacturer specific information (such as, company name, business 
contact information, universal resource locator (URL), etc.), Layer Two - Object 



Characteristics (name, price, sizes available, colors available, etc.), Layer Three - Order 
information (catalog number, catalog page, matching accessories, substitutes if unavailable, 
retail locations, etc.), Layer Four - Manufacturer designated information (miscellaneous data 
included by the manufacturer). 

[0019] To work with watermarking, client applications and printer drivers can be modified to 
incorporate the embedding of multiple layers of metadata into an image or the component 
objects of the image. Once the desired metadata is incorporated to an image or the objects of 
an image, it can be printed on multiple layer watermarking enabled printers. Manners of 
inserting the metadata in a client software application can include, but are not limited to, such 
methods as, right-clicking or double clicking on an image object to insert/associate the 
desired metadata, a menu selection to define metadata for a selected object, and a separate 
configuration file or application spreadsheet area containing metadata for selected/tagged 
objects or image areas that is to be read and incorporated upon printing. 

[0020] To print from a client application to a multiple layer watermarking enabled printer, 
the client applications would utilize special modified printer drivers and generate a page 
description language (PDL) with extensions that would incorporate the metadata into the 
PDL data stream. The client application would print the image incorporating the defined 
objects and one or more of the associated metadata data layers (as optionally selected by the 
user and/or program) through the printer driver. The printer driver would generate a page 
description in a PDL, such as, but not limited to, PCL5, PCL6 or Postscript, and within the 
PDL page descriptions incorporate the defined metadata. Objects would be defined and 
transmitted to the multiple layer watermarking enabled printer in a raster or vector definition 
and the object definition in the PDL would include the metadata to be associated with the 
object in the final printed page. The multiple layer watermarking enabled printer would then 
generate the image and its objects from the PDL definition and embed each associated 
metadata layer within each defined object or page in a multiple layer watermark in that object 
or page image. 

[0021] In another embodiment, as multiple data layers are being defined in association with 
one or more objects or the overall image, differing selected layers can either be printed 
embedded within the final image or printed separately within a separate text area or on a 
separate page. The selection of metadata layers to be printed can occur at the client 
application as part of the printing process/PDL generation. Alternatively, the metadata layers 
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to be embedded or printed in plain text can be selected at the printer. In one embodiment, a 
print job containing all metadata layers is retained indefinitely at the printer and the print job 
and differing layers of metadata can be selected at the printer control panel and printed by 
users as desired. In one such embodiment the differing layers of metadata are 
selected/accessed at the printer by the entry of a user ID or PIN. Such differing printing of 
metadata layers would allow differing views or details for a joint project or document to be 
accessed and printed as desired by differing users or project teams. Such applications 
include, but are not limited to, joint project plans, architectural data, engineering drawings, 
and schematics. Again the selected metadata layers can be printed either separately or 
embedded with a multiple layer watermark in the printed document. 

[0022] Embodiments of the present invention may include a set of computer-readable 
instructions stored on a computer-usable medium for execution by a processor. Examples of 
computer-usable medium include removable and non-removable magnetic media, optical 
media, dynamic random-access memory (DRAM), static random-access memory (SRAM), 
read-only memory (ROM) and electrically-erasable and programmable read-only memory 
(EEPROM or Flash). 

[0023] It is noted that although the invention was described with specific reference to print 
image applications and apparatus it may be adapted for use with other imaging processes and 
applications and should be apparent to those skilled in the art with the benefit of the present 
disclosure. 

CONCLUSION 

[0024] An improved data embedding and watermarking method and apparatus for images 
have been described that allows for multiple levels of data to be encoded and retrieved, 
increasing image data content and information in a manner that will not be separated from the 
image. The various embodiments described facilitate steganographic embedding or 
watermarking of multiple data fields or data layers (image metadata) in an image or in one or 
more of the sub-images/objects (component images) contained in the image. The various 
embodiments include images with two or more data fields embedded into them in two or 
more watermarks of differing encoding or defined within the same watermark at a high 
coding rate. In addition, other embodiments include two or more data fields defined within 
one or more sub-images/objects of the image. Methods and apparatus are also included for 
encoding and decoding the multiple data fields. In one embodiment of the present invention, 
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an image includes multiple layers of metadata, each layer storing a data field of associated 
image data. In another embodiment of the present invention, one or more sub-images of an 
image include multiple layers of metadata, each layer storing a data field of associated image 
data. Embodiments of the present invention allow for the advantages of storing multiple 
layers of associated data embedded with an image or with each sub-image which would not 
otherwise be available allowing it to be retrieved by an end-user with a watermark enabled 
scanner or image reader (herein referred to as a reader). Additionally, embodiments of the 
present invention associate the multiple layers of data directly with an image or sub-image 
allowing the data to be specific to the image/sub-image and contextual, reducing the potential 
for reader misunderstanding and improving communication. Embodiments of the invention 
include apparatus and methods of varying scope. 

[0025] Although specific embodiments have been illustrated and described herein, it will 
be appreciated by those of ordinary skill in the art that any arrangement that is calculated to 
achieve the same purpose may be substituted for the specific embodiments shown. Many 
adaptations of the invention will be apparent to those of ordinary skill in the art. 
Accordingly, this application is intended to cover any adaptations or variations of the 
invention. It is manifestly intended that this invention be limited only by the following 
claims and equivalents thereof. 



